Skip to content

feat(firebaseai): add bidi transcript #17700

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 9 commits into
base: main
Choose a base branch
from
Open

feat(firebaseai): add bidi transcript #17700

wants to merge 9 commits into from
+178 −5

Conversation

cynthiajoan
Copy link
Collaborator

Description

Replace this paragraph with a description of what this PR is doing. If you're modifying existing behavior, describe the existing behavior, how this PR is changing it, and what motivated the change.

Related Issues

Replace this paragraph with a list of issues related to this PR from the issue database. Indicate, which of these issues are resolved or fixed by this PR. Note that you'll have to prefix the issue numbers with flutter/flutter#.

Checklist

Before you create this PR confirm that it meets all requirements listed below by checking the relevant checkboxes ([x]).
This will ensure a smooth and quick review process. Updating the pubspec.yaml and changelogs is not required.

  • I read the Contributor Guide and followed the process outlined there for submitting PRs.
  • My PR includes unit or integration tests for all changed/updated/fixed behaviors (See Contributor Guide).
  • All existing and new tests are passing.
  • I updated/added relevant documentation (doc comments with ///).
  • The analyzer (melos run analyze) does not report any problems on my PR.
  • I read and followed the Flutter Style Guide.
  • I signed the CLA.
  • I am willing to follow-up on review comments in a timely manner.

Breaking Change

Does your PR require plugin users to manually update their apps to accommodate your change?

  • Yes, this is a breaking change.
  • No, this is not a breaking change.

@cynthiajoan
Copy link
Collaborator Author

/gemini summarize

@gemini-code-assist
Copy link

This pull request introduces bidirectional transcription capabilities for Firebase AI. Key changes include:

  • New Configuration: Adds AudioTranscriptionConfig and integrates inputAudioTranscription and outputAudioTranscription into LiveGenerationConfig to enable transcription for both input and output audio streams.
  • Transcription Data Model: Introduces a Transcription class to represent transcription text and its completion status.
  • Live Server Content: Extends LiveServerContent to include inputTranscription and outputTranscription fields, allowing the live server to send transcription updates.
  • Example App Updates: The example application (bidi_page.dart) has been updated to display these new transcription messages in real-time, including logic to append new transcription segments to existing messages. The text field in MessageData was made mutable to facilitate these updates.

This feature enhances the live generation experience by providing real-time text representations of both user input and model output audio.

@cynthiajoan cynthiajoan changed the title feat(firebaseai): bidi transcript feat(firebaseai): add bidi transcript Oct 16, 2025
@cynthiajoan
Copy link
Collaborator Author

/gemini review

@cynthiajoan cynthiajoan marked this pull request as ready for review October 16, 2025 22:13
gemini-code-assist[bot]
gemini-code-assist bot reviewed Oct 16, 2025
View reviewed changes
Copy link

@gemini-code-assist gemini-code-assist bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request adds support for bidirectional transcription in Firebase AI. The changes are well-structured, introducing new configurations and handling transcription messages. I've identified a few areas for improvement, including an unused variable, opportunities to reduce code duplication, and a suggestion to maintain immutability in a data class. My detailed comments and code suggestions aim to enhance code quality and maintainability.

@cynthiajoan cynthiajoan requested a review from Lyokone October 22, 2025 17:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@a-maurice a-maurice Awaiting requested review from a-maurice

@russellwheatley russellwheatley Awaiting requested review from russellwheatley

@Lyokone Lyokone Awaiting requested review from Lyokone

1 more reviewer

@gemini-code-assist gemini-code-assist[bot] gemini-code-assist[bot] left review comments

Reviewers whose approvals may not affect merge requirements

At least 2 approving reviews are required to merge this pull request.

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@cynthiajoan